#reward hacking

Google DeepMind and collaborators introduce Crome, a causal framework that improves reward modeling robustness in LLM alignment by using counterfactual data augmentation to tackle reward hacking issues.

Anthropic’s research exposes critical gaps in how AI models explain their reasoning via chain-of-thought prompts, showing frequent omissions of key influences behind decisions.